Skip to main content

Troubleshooting

IMPORTANT

Before you take any action, always make sure you're using the correct AWS Role for what you want to do

What to do if there is a Queue congestion​

  • Access Amazon SQS Service through on the following link
  • Make sure you're using the corresponding role for the environment you are working on.
  • Identify the congested queue. You may consider a queue is congested if the column 'Messages in flight' has more than 200 messages.
  • Select the congested queue and Purge it as follows

purge_queue

What to do when there are too many connections to the database​

When the database has more than 600 connections for more than 15 minutes we will receive a notification on the #engineering channel on Slack. If this happens there are some things we can do:

  • Run the following query:
SELECT * FROM INFORMATION_SCHEMA.PROCESSLIST
  • Review existing connections and, if possible, terminate them to release connection pressure. For example, start by terminating connections in sleep state. To get those connections run the following query
SELECT id FROM INFORMATION_SCHEMA.PROCESSLIST WHERE commands = 'Sleep'
  • To terminate user sessions or queries currently running on the DB instance you can run rds_kill and rds_kill_query commands:
CALL mysql.rds_kill(thread-ID);
or
CALL mysql.rds_kill_query(thread-ID);
tip

Use the following spreadsheet to prepare your queries. HERE

X

Graph View